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Description 

[0001] The invention hereby presented generally relates to the field of mobile multimedia middle-ware, computer 
networking, distributed processing systems, Quality of Service, handheld computers, web browsers, QoS brokers, QoS 
5 adaptation architectures, QoS negotiation protocols, and wireless communication. 

[0002] Particularly, the present invention relates to a processing system for one or more communication networks 
and to pieces of software for one or more communication networks, the pieces of software being loadable in a memory 
means in one or more notes of the one or more communication networks. 

[0003] The processing system for one or more communication networks according to the present invention is claimed 
10 in claim 1 and provides applications with a platform- and network independent framework for achieving cross-adapt- 
ability by providing components for QoS management in the communication network(s) by means of a component 
coordinator unit 10. The pieces of software for one or more communication networks according to the present invention 
are claimed in claim 21, are loadable in memory means of one or more notes of the one or more communication 
networks and provide applications with a platform- and network in dependent framework for achieving cross-adaptability 
15 by providing components for QoS management in the communication network(s) by means of a component coordinator 
unit 10. 

[O0O4] Advantageous features are claimed in the respective subclaims. 

[0005] Advantageously, the generic framework uses a platform- and network-neutral set of application adaptation 
mechanisms, including a QoS negotiation and re-negolialion protocol. In this case, the protocol may advantageously 

20 use piggyback mechanisms for negotiating and re-negotiating QoS parameters. Further advantageously, the generic 
framework bases on an application model in which each application is allocated to one of a set of application classes 
having different QoS levels. In this case, fallback mechanisms may be provided for a backward compatibility between 
the application classes. Advantageously, said generic framework bases on a modular progressive approach to address 
different types of applications which span from existing applications to envisioned more sophisticated applications that 

25 rely on middleware for achieving cross-adaptability. Further, the generic framework may base on a communication 
model with different functional communication levels for exploiting the various resources in a coordinated manner so 
as to achieve the desired overall QoS level. Hereby, the communication levels may include an application, a session, 
an association and a stream level. 

[0006] Advantageously, a QoS broker unit is provided, which is managed by the component coordinator unit and 
30 coordinates local and remote resource management by using said negotiation and re-negotiation protocol. In this case, 
a network resource booker unit may be provided, which is directly coordinated by the QoS booker unit and manages 
network resource reservation mechanisms. Further, a session manager unit may provided, which is directly coordinated 
by the QoS booker unit for establishing and managing sessions in an implementation-independent way. 
[0007] Advantageously, one or more chain coordinator units are provided, which are managed by the QoS broker 
55 unit and which manages one or more component chains, each chain being associated with a stream. Hereby, one or 
more CPU-manager units may be provided, which are coordinated by the chain coordinator units for managing CPU- 
resource usage. A CPU-resource controller unit may be provided, which provides the CPU-manager units with platform- 
independent resource status information retrieval and control. 

[0008] Further advantageously, one or more memory manager units may be coordinated by the chain coordinator 
40 units for managing memory resource usage. A memory controller unit may provide the memory manager units with 
platform-independent resource status information retrieval and control. Further, one or more network protocol manager 
units may be coordinated by the chain coordinator units for managing network protocol resource usage. The network 
protocol controller unit may provide the network protocol manager units with resource status infomnation retrieval and 
control. 

45 [0009] One or more multimedia component units may be coordinated by the chain coordinator units for managing 
multimedia resources. Here, the multimedia controller may provide the multimedia component units with platform- 
independent resource status information retrieval and control. 

[0010] This invention proposes a universal framework, upon which end-system architectures can be developed, 
providing QoS and mobility awareness to any kind of mobile multimedia and (within certain limits) legacy applications. 
so More specifically, a technical solution (middleware) is hereby described, along with a meta-protocol for End-to-End 
QoS negotiation. These concepts have been designed so as to render applications elastic to QoS fluctuations and/ 
violations with respect to the given QoS contract. 

[0011] The present invention is explained in more detail in the following description in relation to the enclosed draw- 
ings, in which 

55 

Fig. 1 shows a scheme of QoS adaptation framework according to the present invention, 

Fig. 2 shows a scheme of coordinated adaptation versus control mechanisms according to the present invention. 
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Fig. 3 shows an example for an end system reference architecture, 

Fig. 4 shows a scheme of the OSl application layer according to the present invention, 

Fig. 5 shows an example of single and multiple association, 

Fig. 6 shows a formal description of the proposed QoS adaptation framework according to the present invention, 
Fig. 7 shows a logical structure of the negotiated Information according to the present invention, 
Fig. 8 shows a degradation path information exchanged during negotiation according to the present invention, and 
Fig. 9 shows an example for association/stream set-up and hand-over scenarios according to the present invention. 
[0012] The following table 1 gives the definitions of terms used in the present description. 

Table 1 : 



Terminology 


Term 


Definition 


Adaptation 


Mechanisms alterino the aDDlication behavior so much as to comoensate 
any fluctuation and/or even dramatic change in data transmission and/or 
processing quality, based on some user requirements specifying said 
quality. These mechanisms can be included in the application, or provided 
by some external entity (e.g. middleware). 


Application 


A computer program with a user interface. This invention addresses 
however with this tenn also computer programs acting as service providers, 
as e.g. a Video on Demand server. This kind of applications usually does 
not feature any interaction with users locally, except for a system 
administration interface. 


Association 


Relationship between two applications, providing the required reference 
structure for allowing said applications to cooperate. 


Component 


A prefabricated, customizable software unit featuring well-defined 
interfaces. Examples of components are Java-Beans, DCOM-objects, or 
CORBA-objects 


Connection 


Semi-permanent relationship between two nodes in a network; within the 
context of said relationship, data can be exchanged in an exclusive and 
controlled manner. 


Deadline 


A time limit, for the completion (or the fulfillment of a quota) of a task 
assignment. 


Degradation Path 


A list of alternative QoS profiles, each associated with a specific set of 
altered conditions with respect to the reference QoS requirements originally 
specified by the user This list is used by QoS Brokers in order to degrade 
(or upgrade) the QoS in a controlled manner. 


Device Driver 


A piece of software that enables a computer to communicate with a 
peripheral device. 


Differentiated Services, DifTServ, DS 


Architecture providing different levels of service based on the differentiation 
of classes of Internet traffic. Rather than simply providing the same "best- 
effort" service to all networi< demands. Differentiated Services hopes to 
achieve a higher quality of service by differentiating between the needs of 
various predefined classes of service. 
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Table 1 : (continued) 





Tenninology 




Term 


Definition 


5 


Elastic Application 


Application featuring adaptation, either through some built in capabilities, 
or thanks to some external means. An application capable of dealing with 
mutated networking and computing conditions in a controlled manner. 


10 


Frameworlc 


A set of correlated software units, embodying an abstract design for 
solutions to a number of related problenns. 




IHand Ovpr / Hand Off 


*THo mor>h£4nicm nf l^o^ninn a onnnor^tinn alK/o tA/hil^ nno nf tHo 
1 1 ic 1 1 issKti idi iioi 1 1 \ji iwsxs\ji\\\^ et II icwiiuii ctiivc wi iiic \j\ \xs \j\ u ic 

corresponding nodes Is moving across interconnected network 
infrastructures. 


15 




1 ne iranspon oi auuio, viueo, reai-iime, anu classical ciaia trairic wiinin a 
single network Infrastructure. Accomplished by reserving and allocating the 
proper amount of network resources to each given connection, based on 
the type of traffic that shall be carried over said connection. 


20 


Mobility, User 


The ability of a user to access telecommunications services from different 
terminals and different networks, and the capability of the network to Identify 

anrt aiithoriTC* that iicor 


25 


Mobility, Tenninal 


The ability of a terminal to access telecommunications services from 
different locations and while in motion, and the capability of the network to 
identify and locate that terminal. 


30 


Multimedia Service 


A service in which the interchanged information consists of more than one 
type (e.g. video, voice, data, and graphics). Multimedia services have multi- . 

vdiUcLj diinuuLcs, wnicn □isLinguisn Lnsm ii om irauiiionai LsiecoiiuiiuniudLiQn 
services such as voice or data. A multimedia sen/ice may involve multiple 
parties, multiple connections, the addition/deletion of resources and users 
within a single session. 


35 


Negotiation 


Mutual discussions intended to produce an agreement with another party 
or parties. More specifically, QoS negotiation deals with the sorting out of a 
mutual set of QoS characteristics, as a tradeoff between each party's 
requirements. 




Process 


A part of a running software program or other computing operation that does 
a single task 


40 


Quality of Service, QoS 


The collective effect of service performance whicti determir^es the degree 
of satisfaction of a user of the service 


45 


QoS Broker 


Software unit orchestrating local, remote, and network resources, in order 
to provide and maintain a given level of QoS, as requested by all the 
cooperating parties. More specifically, the QoS Broker coordinates resource 
management across the various software and hardware units used within 
the system. To this extent, the QoS Broker manages QoS parameter 
translation, admission test, and negotiation. Therefore, the QoS Broker acts 
as an intermediary, dispensing cooperating entities from being aware of 
operational details concerning with other entities. 


SO 


QoS Contract 


Agreement between a user and a given service provider, specifying QoS 
requirements and constraints, as well as the policies required to keep track 
about QoS during all phases of said service. 



55 
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Table 1 : (continued) 



Terminology 


Term 


Definition 


QoS Contract Type 


Reoresents a OoS Cateaoiv it caotures the structure of a class of OoS 
Contracts, by identifying how individual QoS Contracts specify the QoS 
properties over a given set of QoS parameter types (also known as 
dimensions). Each parameter type consists of a name and a domain of 
values. QoS specifications can be simply intended as a set of constraints 
over said domains, one per parameter type. 


QoS Profile 


Associates one or many QoS Contracts with a set of interface elements 
(methods) for a given interface. 


QoS Violations 


QoS Contract violations, which might occur even with service guarantees, 

bscflij'=;p of ^p*^olJr^'p«^ '^hortanp p n nptwnrk connp^^tinn 

ki' wd LhJO^ wI IwOwLJf ^.^ WW OIIV./ltClvJw, W<W-; IIWLVV^Irx WW) 1 u wO L] W 1 1 < 


Real-time OS 


An Operating System featuring real-time capabilities. Real-time is a human 

respo/is/Vaness that a user senses as sufficiently immediate or that enables 
the computer to keep up with some external vital process 


Session 


A multimedia session is a set of multimedia senders and receivers, and the 
data streams flowing from senders to receivers. A multimedia conference 

is an example of a multimedia session. Within the context of this Invention, 
a session is an even more generic, not necessarily bound to multimedia 
concepts. 


StreanrVFlow 


The sequence of information being transmitted from the source endpoint to 
the destination endpoint of a given connection 


Task 


The basic unit of programming that an operating system controls. 
Depending on how the operating system defines a task in its design, this 
unit of programming may be an entire program or each successive 
invocation of a program. 



[0013] The following table 2 gives a list of abbreviations used in the present description. 

Table 2: 



Abbreviations 


AAA 


Authentication, Authorization, Accounting 


ACSE 


Association Control Service Element 


ACTS 


Advanced Telecommunication Technologies & Services 


AE 


Application Entity 


AEI 


Application Entity Instance 


AP 


Application Process 


ASE 


Application Service Element 


CASE 


Common ASE 


COTS 


Commercial Off-The-Shelf 


HW 


Hardware 


GUI 


Graphical User Interface 


IP 


Intemet Protocol 


MACF 


Multiple Association Control Function 
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Table 2: (continued) 



Abbreviations 


MMU 


Mennory Management Unit 


NRB 


Network Resource Booker 


PDA 


Personal Data Assistant 


QoS 


Quality of Sen/Ice 


SACF 


Single Association Control Function 


SAO 


Single Association Object 


SASE 


Specific ASE 


SW 


Software 


UE 


User Element 


UML 


Unified Modeling Language 



[001 4] As of this writing, following technologies are known, which are closely related to the topic hereby presented: 





Sub-Topic 


Technologies 


IP Owner Organizations and /or 
Companies 




OoS Broker 


• QoS Broker 


Many academic-works have been pubtished 


25 


QoS Negotiation 






30 


Context Negotiation 


' OS! Presentation Layer: Context 
Negotiation Protocol 


iSO, ITU-T (Rec. X.216 (07/94) 
INFORMATION TECHNOLOGY... OPEN 
SYSTEMS INTERCONNECTION... 
PRESENTATION SERVICE DEFINITION) 



[0015] Table 3 lists the problems addressed by this invention. Each problem is identified by a PJD identifier, later 
used for easy referencing the given problenn Item. Furthemriore, a Key Aspec/field captures the most meaningful aspect 
of the given problem item. 

35 

Table 3: 



Lists of problems addressed by this invention 


PJD 


Problem Description 


Key Aspect 


1 


Existing architectures do not take into account how uar/ous types of applications can 
manage end-to-end QoS in mobile scenarios. 


Interoperability 


2 


Many of the existing architectures are not modular, rather full-fledged solutions 


Modularity 


3 


Many of the existing architectures make some assumptions on the network resource 
reservation and allocation mechanisms 


Configurability 


4 


The mechanisms dealing with application adaptation to mutated conditions of the 
network and of the computing environment (e.g. QoS violations, changes in resource 
utilization) have been addressed so far wittiout a clear distinction of the various phases 
of applications and communbations lifecycles. 


Adaptability 


5 


Negotiation protocols have been so far defined as proprietary protocols. 


Standardization 



[001 6) Different service interfaces can be identified above the OS I Transport Layer. Each interface serves a specific 
type of application. Table 4 describes each possible type of applications with respect to QoS and mobility aspects. The 
55 interface identifier indicated in the last column of said table is thereinafter used for referencing application types. 
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Table 4: 





Application Taxonomy 


5 


Legacy 


Not QoS-aware 


• Use sheer transport services. 

• QoS can be externally enforced - transparently to the applications - 
by manipulating packets (DiffServ marking) and/or explicitly reserving 
network resources (e.g. RSVP) through a configuration tool. Example: 
web browser 


A.1 


10 




QoS-aware 


• Limited use of a QoS -Enabled Transport Sen/ice Interface, In 
conjunction with the aforementioned configuration tool. 


A.2 


15 


QoS-aware 


Self -managing 


• Use existing (or soon-to-be-defined) OSl Session Layer protocols (e. 
g. SIP, H.323, RTP/RTCP) and QoS signaling protocols (e,g. RSVP) 

• Capable of perfonning DiffServ Marking 

• Feature adaptation logic for handling QoS violations 

• Directly handle multimedia resources (e.g. Frame Grabber, codecs). 
Example: Voice over IP clients 


B.1 


20 
25 
30 




Component -based 


• Use abstract Session Layer Components, which can be mapped to 
any existing or future standard Session Layer protocols. 

• Can use prefabricated multimedia components. 

• Can use a framework (Component Coordinator-CC), which manages 
how components are pushed in / pulled out to/from a flow, and 
eventually reconfigured, in a dynamic manner, 

• Can include a proprietary full-fledged QoS Broker that (as one of its 
multiple functionality), can manipulate multimedia components through 
said CC. This functionality is however limited to the given application. 
Resource coordination with other applications can be made only 
indirectly, as long as proper low-level resource monitoring and control 
mechanisms are made available (e.g. through the OS). This is an 
envisioned kind of applications, not yet available on the market. 


B.2 


35 
40 




Broker-assisted 


• Use an extemal QoS Broker through a non-procedural language. 

• The QoS Broker can manage multiple applications, as opposed to the 
B.2 and (eventually) B.1 QoS Broker functionality, which Is limited to 
one application only. 

• Users control the perceived QoS through a separate, application 
independent, QoS Broker GUI. either in an entry levei or expert mode. 

• Template user profiles are made available to users, who can use them 
for creating their own profiles, either program-assisted (entry-level 
mode) or directly (expert mode). This is an envisioned kind of 
applications, not yet available on the market. 


B.3 



[001 7] This invention focuses on architecture providing QoS and mobility awareness to all the aforementioned types 
of applications. More specifically, a technical solution (middleware) is hereby described, with respect to application 
types B.2 and B.3, and to the relationship of said application types with the other listed ones above. Table 5 summarizes 
the hereby-proposed solutions to the problems fisted in Table 3. 



Executive summary of claimed solutions 


PJD 


Key Aspect 


Solution Description 


1 


Interoperability 


Concerning the (re)negotiatton process, the various types of applications described in 
Table 4 need to feature some form of backward compatibility, through fallback 
mechanisms. This invention describes such mechanisms in Table 6. 
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Table 5: (continuod) 





Executive summary ot ctaimed solutions 




P_ID 


Key Aspect 


Solution Description 


5 
10 


2 


Modularity 


Various types of applications can benefit from the proposed arcliltecture, by using 
exactly the amount of support they need for accomplishing their tasks. Moreover, a 
component-based model allows applications to reuse commercially available 
multimedia components. One can also replace the latter with other components, based 
on mutated conditions (QoS violations) and/or cost factors (better quality/price ratio). 
S^^e S Modularitv 

V^C^w VJ 1 V 1 W V.I U Id 1 i^y. 


15 
20 


3 


Configurability 


The proposed architecture is not tightly coupled to any particular network model. For a 
description purpose only, the given architecture is described with respect to an edge IP 
network scenario. Users' network packets enter/exit the network through an IntServ- 
based radio access network. Whereas the long haul traffic traverses as a DiffServ 
aggregate a core IP network (an Intranet or the Internet). The architecture can however 
be configured so as to use any available means for QoS signaling mechanism. To this 
extent: a Network Resource Booker (NRB) component is hereby defined. The 
configuration tool indicated in Table 4 with respect to application types A.1 and A.2 is 
basically a GUI for interactively managing said NRB component (which can be in any 
case used programmatically). See § Configurability. 


25 


4 


Adaptability 


This invention presents an application and communication models, which identify the 
major lifecycle phases of a multimedia application; each phase Is associated with a 
specific adaptation mechanism. These mechanisms are organized in a framework. See 
§ Adaptation mechanisms. 


30 


5 


Standardization 


This invention proposes the use of a platfomn- and network-neutral negotiation and re- 
negotiation protocol. Given that SIP features both these characteristics, the hereby 
proposed (re)negotiation protocol resembles said standard. See § Proposal of a 
Standard QoS Negotiation Protocol. A SIP binding is hereby described as well. See § 
Example. 



[0018] As an option, each application class can be associated with a set of agents, for guaranteeing end to end 
coordination to the greatest possible extent. Each agent would be tailored to deal with each case of backward com- 
patibility, as indicated in Table 6. 

Table 6: 





Backward Compatibility Mechanisms 


40 


From 


To 


Faiibacli Mechanism Description 


45 


B.3 


B.2 


8.3 and 8.2 QoS Brokers may be incompatible: in such a case, after a failed negotiation attempt, 
the peers will handle resources only locally Otherwise the usual full-fledged negotiation process 
can take place. 

in the opposite direction, if B.3 applications cannot handle the negotiation process initiated by B.2 
applications, resources are managed only locally. 


SO 




B.1 


8.1 applications may feature no negotiation at all or a form of negotiation that is incompatible with 
the QoS Brokers assisting B.3 applications. In such a case, after a failed negotiation attempt from 
B.3, the peers will handle resources only locally. 

In the opposite direction, B.1 initiating applications may start some form of negotiation: If B.3 
applications cannot handle this, resources are managed only locally. 






A.2 


No negotiation takes place at all. In the case of a B.3 initiating applications, a negotiation attempt 
would fail. Resources are managed only locally. 


55 




A.1 


No negotiation takes place at all. In the case of a B.3 initiating applications, a negotiation attempt 
would fail. Resources are managed only locally. 
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Table 6: (continued) 



Backward Compatibility Mechanisms 


From 


To 


Fallback Mechanism Description 


B.2 


B.1 


B.1 applications may feature no negotiation at all or a form of negotiation that Is Incompatible with 
the QoS Brokers included into 8.2 applications. In such a case, after a failed negotiation attempt 
from B.2, the peers will handle resources only locally. 

In the opposite direction, B.1 initiating applications may start some form of negotiation: if B.2 
applications cannot handle this, resources are managed only locally. 




A.2 


No negotiation takes place at all. In the case of a B.2 initiating applications, a negotiation attempt 
would fail. Resources are managed only locally. 




A.1 


No negotiation takes place at all. In the case of a B.2 initiating applications, a negotiation attempt 
would fail. Resources are managed only locally. 


B.1 


A.2 


No negotiation takes place at all. In the case of a B.1 Initiating applications, a negotiation attempt 
(if any) would fail. Resources are managed only locally. 




A.1 


No negotiation takes place at all. In the case of a B.1 initiating applications, a negotiation attempt 
(if any) would fail. Resources are managed only locally. 


A.2 1 


A.1 


No negotiation takes place at all. 



10 



15 



20 



I. Modularity 

25 [0019] The proposed architecture Is modular with respect to two aspects: 

• The architecture harmonizes various types of applications, which may or may not be compatible with each other. 
This modular approach allows developers to progress/Ve/y deploy the given architecture. 

• The middleware solution hereby proposed is centered on the concept of a component model API. The QoS Broker 
can be a component itself. Components can even be deployed at runtime (e.g. components developed as Java 
Beans can be downloaded from a remote repository). In order to deal with components, the hereby-proposed 
middleware is centered on the concept of a Component Coordinator (OC). The CC allows user applications to 
manipulate components and control their lifecycle (deployment, configuration, activation, deactivation, and dis- 
posal). l\^ore specifically, components can be "chained together", so as to combine their functionality in such a 
way information gets processed in a given, desired manner. Applications and/or the QoS Broker can modify chains 
even at runtime, so as to promptly respond to a given stimulus (e.g. change codec). 



30 



35 



II. Configurability 

40 [0020] The proposed architecture is configurable with respect to two aspects: 

• The QoS-Enabled Transport Interface can be configured so as to map to specific QoS Signaling Protocols. E.g. a 
socket based QoS-Enabled Transport Interface can be configured so as to use RSVP and/or a DS Marker for 
resource reservation/allocation signaling. This configuration can transparently affect even type A.1 applications. 



45 



so 



55 



Each component in the Component Model API can be individually configured. Applications type B.2 and the QoS 
Broker usually manage components configuration through the CC. 

Concerning applications type B.3, the QoS Broker takes into account User Profiles information (or configuring 
both component chains and lower-level entities (e.g. the QoS Signaling, network, and data link protocols). 
The User's Profile information can be specified at high or low level of detail. In the fomier case, the QoS Broker 
shall perform QoS parameter mapping {\,e. translating user's high level requirements into a set of configuration 
parameters for each lower layer). In the latter case (expert mode), partial or even no QoS parameter mapping 
is required (depending on the expertise level of the user). 

Users can also specify additional configuration information, also known as degradation paths. Each degrada- 
tion path takes into account alternative QoS parameter configurations, to be used for addressing a given type 
of QoS violations in a pre-p/anned fashion. 
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In order to facilitate users specifying tlieir profiles, templates containing reference configurations can be made 
available. The QoS Broker therefore relies on a User Profiie Database, 

A candidate Implementation for User Profile description languagecou\6 be QML Svend Frolund, Jari Koistinen, 
QML: A Language for Quality of Service Specification, Hewlett-Packard Laboratories Technical Report HPL- 
5 98-10 980210, Palo Alto, where QoS contracts are defined as associated to interfaces. 

III. Adaptation Mechanisms 

[0021] The following models are hereby proposed: Application Model and Communication Model. Individual adap- 
10 tation mechanisms are described for each model. Aggregate adaptation mechanisms are finally presented at the end 
of this paragraph. 

Iil.1 Application Model 

15 [0022] This model focuses on the application llfecycle, with respect to local resources. Examples of resources are 
CPU, primary memory, network protocols, multimedia devices for each of the tasks that the application, as process, is 
composed of. Usage and QoS guarantees. As often pointed out in the literature, providing QoS in the network is not 

sufficient for guaranteeing that the users get the level of quality they ask (and pay) for. 

[0023] Local resources are typically scarce in mobile computing devices like a PDA or a mobile phone. This scarcity 
20 can cause QoS degradation as soon as concurrent applications and/or simultaneous connections begin to compete 
for the limited amount of resources. 

[0024] Basically one has to take into account that each new start of an application (thereinafter, an enfry) may require 

the system to reshuffle resources so as to accommodate the new entry. 

[0025] Each application run has a specific importance for the system and, ultimately, for the user. For example, this 
25 concept can be mapped to priority and deadline in a real-time OS for each task belonging to the given application. 
Therefore, the reshuffle process shall take into account the importance of the new entry with respect to the importance 
of the already allocated ones. This and other information can be associated with an application through an application 
OoS contract. This invention does not describe explicitly the QoS Contract content. The scope of this invention is in 
fact to provide a framework upon which specific solutions can be built. 
30 [0026] This process can be based on a set of aggregate importance classes. These classes range from a (cheap) 
no-QoS-assurance class, up to an (expensive) premium-QoS-enforcement class. 

[0027] Each application is assigned a given class, and will be tentatively assigned resources, according to the class- 
specified level of QoS. 

[0028] Should resources not be available at admission test, applications belonging to lower classes would be as- 
35 signed fewer resources until the new entry can be accommodated. This fallback (The term fallback applied to this 
process must not be confused with the similar term used for designating backward the compatibility mechanisms in- 
dicated in Table 6.) process begins from the class immediately below the one of the given application, and eventually 
continues (Other applications, with a higher or equal class compared to the one of the new entry, may have already 
been degraded to the given lower class. In such a case, the new entry is not entitled to seize any resource allocated 
40 to those applications. If no spare resources are available for the current class and all the allocated applications have 
a higher or equal class compared to the one of the new entry, the fallback process must be iterated further to the 
immediately below class.) to tower classes, until resources are finally made available to the new entry. 
[0029] The same process applies to each application that has been degraded to a lowerclass. Applications belonging 
to the lowest class can be eventually preempted by applications with a higher class. Therefore this fallback process 
45 features a cascade mechanism. 

[0030] The tailback mechanism can be triggered also by hand over events (for more details see following para- 
graphs). 

[0031] The user has the possibility to control the aforementioned fallback mechanisms, by providing an application 
degradation path in addition to the application QoS contract. Such information would steer the fallback mechanism the 

50 way the user prefers. 

[0032] For no reason, an application of given class can affect other applications of higher or equal class. Class 
promotions (and demotions) of applications, based on user preferences, are however possible. Proper AAA mecha- 
nisms shall regulate such user's requests. 

55 111.2 Communication Model 

[0033] Let us consider now a given application that wishes to establish a communication channel with one or more 
peers. The term peer is hereby used in a broad sense, so as to include even asymmetric client-server scenarios. Each 
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peer could be an application running either on the same, or on a remote-processing unit. Both cases can be addressed 
similarly, except that the latter deals with additional constraints concerning the usage of network infrastructure resourc- 
es. 

[0034] Generally speaking, applications can communicate with other peers within the high-level context of a session. 
5 As an example, a videoconference application would manage separately each conference in a session. 

[0035] The session can then be broken into finer grained communication abstractions, the associations. Continuing 
the previous example, an association would represent a conference leg, i.e. the association between any two of the 
peers participating in said conference. 

[0036] Finally, each association can be either mapped to a physical connection, or further decomposed in a set of 
10 information flows^ or streams. This abstraction typically applies to multimedia applications. 

[0037] Sessions, associations, and streams can be assigned each a QoS contract. The user can then pick up a 
specific configuration of the parameters indicated in template QoS contracts, and realize them into a corresponding 
set of QoS User Profiles (for more details, see § Adaptation Framework). 



15 III.2.1 Session Establishment 



[0038] The application can establish a session, provided that enough local and remote resources (Examples of ses- 
sion resources may be session priority, number of associated windows, estimated memory consumption for session 
control mechanisms.) are available. As an example, a small computing device may not support an unlimited number 
20 of sessions without running out of memory, or clogging up shared resources, like a display. 

[0039] An adaptation mechanism similar to the one described in § Application Model can be applied to this phase 
as well. 

[0040] Additionally, in order to check whether both peers are able to handle a given session, a negotiation process 
should take place. This invention proposes however a /azy approach: the session negotiation phase is deferred to the 

25 first association establishment (see § Association Establishment). This approach aims to reduce set-up time and net- 
work traffic. Please note that at session level, a negotiation process would be required for each peer participating in 
said session. Furthermore, the identity of said peers might not be known at session establishment phase. 
[0041] In any case, the session has to deal with the coordination of session negotiation results originating from 
multiple association establishments: e.g. certain peers might not be able to manage a given session with the required 

30 QoS. The point is that each association might be either independent from- or tightly coupled to other associations. For 
instance: for the former case a videoconference, for the latter an online game or a distributed application. In the latter 
case, application-specific policies shall steer the overall negotiation process (e.g. suspend or even tear down the 
session, or simply degrade each association to a common QoS floor-level). 



35 lii.2.2 Association Establishment 



[0042] This process translates into the establishment of one or more physical connections. Within a session, the 
application can establish an association, provided that enough local and remote resources, as welt as network resourc- 
es (This does not apply to the case of peers residing on the same computing unit), are available. 

40 

1 . admission test (CPU, multimedia devices, and primary memory): verifies whether enough resources are avail- 
able locally. Similar 

2. fa/Zbac^mec/^an/sm; similar to the one described in § Adaptation MechanismS: this mechanism is class-based. 

45 

3. negotiation: Includes estimated protocol- (and, only for communication with remote peer, network-) resources 
usage, and a degradation path to be agreed upon. As indicated in § Session Establishment, session negotiation 
is included in this phase as well (during to the first physical connection establishment). This negotiation process 
takes also into account any eventual stream (Streams are assigned a QoS Contract as well as applications, ses- 
sions, and associations), which might be established within the given connection. If known a priori. For instance, 
a given association can be established with an audio, a video, and a data stream. This information is generally 
known at association establishment time. 



4. OoS Signaling (only for communication with remote peer); once the two peers have come to a negotiation 
agreement, network resources can finally be requested, by using whatever QoS signaling mechanism is available 
(e.g. RSVP and/or DS marking). 

[0043] The association establishment can be considered as subdivided into two phases: at first, best effort connec- 
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tivity is used for establishing the association and performing negotiation. Subsequently, as soon as the parties have 
agreed upon a common set of QoS, resources are allocated correspondingly to the desired QoS level. A similar mech- 
anism applies in reaction to QoS violations. 

5 III.2.3 Stream Establishment 

[0044] Streams can be eventually created during the lifetime of an association, upon users* requests or as a conse- 
quence of a recovery from a temporary service disruption (see § Runtime and Hand-Over). In such a case, the admission 
test, negotiation, and QoS signaling mechanisms described in § Association Establishment shall apply. With the ex- 
10 ception that no session negotiation would be required. 

III.2.4 Runtime and Hand-Over Events 

[0045] Following are the mechanisms that shall be used for managing QoS and mobility aspects within the context 
15 of a session. 

1 . QoS monitoring 

2. QoS enforcement 

20 2.1. flow management (poiicing, shaping, shaping, synchronization, etc) 

2.2. resource control (e.g. acting on the network/cpu scheduler) 

2.3. application reconfiguration (e.g. modifying component chains) 

2.4. renegotiation (e.g. as a consequence of a Hand-Over event) 

25 [0046] To this extent, this invention introduces the following distinction: coordinated adaptaHon vs. controL 

111. 2. 4.1 Coordinated Adaptation 

[0047] Coordinated Adaptation is any mechanism, which allows peers to recover from sensible mutated conditions 
30 (QoS violations and/or changes in resources usage) in a coordinated manner. More specifically, this implies the ne- 
cessity of performing renegotiations. Coordinated Adaptation can thus be regarded to as a horizontal process, 
[0048] This invention introduces the concept of a renegotiation strategy (RS), based on degradation paths, that shall 
be agreed upon by peers at connection establishment time. The RS specifies a policy both peers shall follow when 
the conditions for renegotiations occur. Two policies can be identified: 

35 

Pre-planned sequence: based on the information describing the mutated conditions (e.g. a QoS violation), both 
peers know how to degrade to a lower class of QoS in a similar fashion. The renegotiation process is thus implicit. 
Consequently, no network traffic needs to be originated for managing this process. 

40 - Index-based renegotiation: the two peers can independently evaluate a lower QoS Class the given session should 
be degraded to. Renegotiation messages would be then exchanged, simply carrying the chosen set of references 
to the original degradation path items. This renegotiation process is thus explicit (i.e. requires some network traffic), 
but on the other hand the peers have more freedom in choosing the best degradation path for a given situation. 
For instance, fuzzy logic algorithms have been proven to be effective for reconfiguring QoS-related parameters in 

45 response to mutated conditions. 

111.2.4.2 Control 

[0049] Each peer shall take any possible action locally, in order to effectively and efficiently react to any mutated 
so condition in the local computing unit and/or in the network, before ever relying on any specific adaptation mechanism. 
Control can thus be regarded to as a verf/ca/ process. 

[0050] Given that the set of QoS parameters can be globally described as an element in a given n-dimensional space, 
the peer can use any control theory based mechanism, forcing said element to stay within a given region centered on 
the element. 

55 [0051] This can translate for instance in the fallback mechanism described in § Application Model, and/or reconfig- 
uring component chains (see § Runtime and Hand-Over Events). 
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111,3 Adaptation Framework 



[0052] The overall adaptation framework is depicted in Figure 1 , by following Profile 5a-5d, Contract 6a-6d. and 
Contract Type 7a-7d concepts, as well as the extended UML graphical notation. 
5 [0053] QoS Profiles 5a-5d specify the binding of a given QoS contract 6a-6d (which is problem domain-specific, but 
implementation-independent) with a given interface. In this case, the interfaces are QoS Management interfaces as 
supported by the application itself and/or by the middleware. 

[0054] As partially indicated in the previous paragraphs, applications 1 may be required to perfomn session 2 coor- 
dination, sessions 2 may be required to coordinate associations 3, and associations 3 may need to synchronize streams 
10 4. 

[0055] This recursive dependency scheme reflects onto the various QoS Profiles 5a-5d. More specifically, metrics 
and policies will be needed: the fomner tor specifying synchronization constraints (e.g. maximum tolerable lip-sync 
delay), the latter for indicating which type of actions should be taken when the synchronization is lost (e.g. automatically 
recover or ask user intervention). 
15 [0056] Figure 2 summarizes In a more organic manner the various mechanisms so far described, putting in evidence 
the distinction between coordinated adaptation and control mechanisms. 

[0057] More specifically, the figure indicates that the fallback mechanism described in § Application Model applies 
not only to the Application 1 . but also to the Session 2, Association 3, and Stream 4 abstractions. The reason is that 
each of the aforementioned abstractions uses local resources in various (implementation dependent) manners: e.g. 

20 session 2 may be associated to a certain number of tasks, each demanding some CPU and memory resources. 

[0058] In order to be effective, the admission test and fallback mechanisms can thus be performed in a hierarchical 
manner, where at step n an estimated (or default) number of instances of the n+1 abstraction are taken into account. 
This distributed approach guarantees that resources are effectively committed only 11 a minimum, meaningful function- 
ality can be offered to the user. 

25 [0059] For Instance, it would not make any sense to start a videoconference in a resource-constrained mobile device, 
if no resources are available for at least one connection. 

[0060] This form of booking mechanism is also meant to speed up the establishment of connections. 



IV. End System Reference Architecture 

30 

[0061] Figure 3 provides a graphical representation of the application taxonomy presented in Table 4, with respect 
to existing protocols and the hereby-proposed middleware (see Table 7). 



Table 7: 



Description of the Software Units and Components 


Unit Name 


Unit Description 


QoS Broker 8 


Component providing applications with the highest level of QoS awareness. The 
QoS Broker 8 basically manages any local and remote resource as a sort of OS 
extension. To this extent, all the applications running on a given end system will 
then be using and/or Influenced (either indirectly - as in the case of applications 
type A. 1 up to B.1 - or directly) by such component. 

The QoS Brokers maps QoS parameters throughoutthe middleware, the protocol 
layers, the OS, and any multimedia component that might been used. The 
mapping Is bi-directional, i.e. from User QoS Profiles down to low-level tunable 
firmware, and vice versa. 

Furthemriore, the QoS Broker 8 implements the aforementioned adaptation 
mechanisms, delegating however low-level tasks to other specific components. 
The QoS Broker 8 offers applications with a high level QoS Interface, thus 
enabling them to request services from tower layers, along with given high-level 
QoS User Profiles. 

In particular, the QoS Broker 8 manages the negotiation protocol described in § 
Proposal of a Standard QoS Negotiation Protocol. In order to be implementation 
independent, the QoS Broker 8 uses Session Manager component 11 , which 
abstracts session level details (e.g. the use of H.323 protocols or SIP). 
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Table 7: (continued) 





Description of the Software Units and Components 




Unit Name 


Unit Description 


5 
10 




In order to deal with QoS signaling, the QoS Brokers uses the Network Resource 
Booker component 9, which abstracts network resource reservation and 
allocation mechanisms (e.g. the use RSVP and/or DS in IP based solution). 
The QoS Broker 8 manages multimedia components (see below), by configuring 
component chains. Should adaptation been required, the QoS Broker shall 
reconfigure said chains and/or even substitute some components within the given 
chains. 


15 
20 


Component Coordinator 10 


This software unit provides applications with a generic framework for managing 
components. More specifically, this unit 10 deals with component and component- 
chain lifecycle (deployment, activation, management, deactivation, and disposal). 
A component-chain can be managed as a whole by the Chain Coordinator 

component. 

During the deployment phase, this unit 1 0 can even download components from 
remote repositories (e.g. CORBA or Java Beans components). To this extent, this 
unit abstracts all the platfonn specific mechanism for locating and downloading 
said components. 


25 


Chain Coordinator 12 


This component 12 manages one or many component chains in order to 
guarantee flow synchronization within the tolerances requested by the user. 
Furthemnore, this entity concentrates QoS events being generated by the 
monitors associated with each component, in order to provide the QoS Broker 8 
with refined and concise information. 


30 


Session Manager 1 1 


This component 11 coordinates sessions and abstracts any session level detail 
(e.g. the use of H.323 protocols or SIP). The session manager 11 is responsible 
for the Session (see § Communication Model) establishment and management, 
(n particular this component 11 shall report to the QoS BrokerSany QoS violation 

Qinnal npnpratAri hv thp lowi^r nrotrir*ol lav/ATQ ui/hioh rninht nfv*iir rliirinn th^ 

OIUIiCllj UCI Id t^y LI Ivr Iv^VYC^I L.II wLU(>>\i./l ICly^'^; VV I llwl 1 IIIIUIIL Wv^Ul UUIIliU LI IC7 

lifetime of a session (e.g. a Hand-Over event).. 


35 


Networic Resource Booker 9 


This component 9 abstracts network resource reservation and allocation 
mechanisms (e.g. in IP based solution, a RSVP daemon and/or a DS marker). 

1 1 llo k'iJI 1 l^UI Id 11 %7 \*Cil i U%S UOCU OlCll lUCIIUI ICT 1 l/i Cl^|JII^ClllLII 1 Ly^C^O AA. 1 , r\.£. \*Jj Udll 1^ 

QoS Signaling transparently to the application), and 8.1 . 


40 


CPU Manager 13 


Each instance of this component 13 manages CPU (local) resource usage for a 
ciiv6n flow Mors soecificaltv this comDonsnt enforces flow-t)AS6d OoS control 
mechanisms like flow policy, shaping, monitoring, etc. Monitors are put in 
evidence in Figure 3. 


45 


Memory Manager 14 


Each instance of this component 14 manages primary memory (local) resource 
ussoe for a aiven flow More soecificallv this comoonent enforces flow-based 
QoS control mechanisms like flow policy, shaping, monitoring, etc. Monitors are 
put in evidence in Figure 3. 


50 


Multimedia Component 16 


Each component 1 6 consists of eitherself -contained software entities (like a QoS 
filter) or software drivers for a specific device (e.g. a frame grabber). Monitors are 
put in evidence in Figures. 




N twork Protocol Manager 
15 


Each instance of this component 15 manages network protocol (focal) resource 
usage for a given flow. More specifically, this component 1 5 enforces flow-based 
QoS control mechanisms like flow policy, shaping, monitoring, etc. Monitors are 
put in evidence in Figure 3. 



55 



14 

BNSDOCID: <EP 1158740A1J_> 



10 



15 



20 



25 



30 



35 



EP1 158 740 A1 

Table 7: (continued) 


Description of the Software Units and Con^ponents 


Unit Name 


Unit Description 


CPU Resource Controller 17 


A per-computing-unit centralized software unit 1 7, offering the aforementioned 

CPU Managers with fine CPU control and monitor. This unit 17 is platform 
dependent, but communicates with said managers through a platform 
independent interface. More specifically, this unit allows CPU scheduler 
management (e.g. changing quanta and/or deadlines assigned to each task). 


Memory Controller 18 


A per-computing-unit centralized software unit 18, offering the aforementioned 
Memory Managers 14 with fine CPU control and monitor. This unit 1 8 is platfomi 
dependent, but communicates with said managers through a platfomri 
independent interface. More specifically, this unit allows fine primary memory 
management (e.g. MMU management). 


Multimedia Controller 20 


A per-computing-unit centralized software unit, offering those Multimedia 
Components 16 that deal with a specific hardware multimedia device, with fine 
device control and monitor. This unit is platform dependent, but communicates 
with said managers through a platfonn independent Interface. 


Network Protocol Controller 
19 


A per-computing-unit centralized software unit 1 9, offering the aforementioned 
Network Protocol Managers 15 with fine control and monitor mechanisms over 
the protocol stack. This unit 19 is platform dependent, but communicates with 
said managers through a platform independent interface. More specifically, this 
unit allows fine lacal network resources management (e.g. packet buffer size or 
packet scheduling management). This unit can be interfaced to a data link / 
physical protocol layers manager unit, in order to allow fine parameter tuning and 
control over said protocol layers from within the QoS management plane. To this 
extent, the QoS and Mobility Enabled Transport interface indicated in Figure 3 
would then redirect QoS-related infomriation/operation to the QoS Management 
plane and, through the Network Protocol Controller, to the data link / physical 
protocol layers manager unit. This unit is not explicitly indicated in Figure 3. It is 
envisioned that the interface between the Network Protocol Controller and the, 
data link / physcal protocol layers manager unit will be standardized in the next 
future. 



V. The proposed QoS Adaptation Framework from an OSi perspective 



40 



45 



[0062] The purpose of this paragraph is not to rigorously map the hereby-presented framework to the full-blown OSI 
architecture, rather to indicate the analogies between the concepts presented so far, and some key aspects of the OSI 
model. 

[0063] Purpose of the OSI standard is to define the information exchange among open systems. Systems that can 
freely cooperate in order to achieve a common objective. Key aspects of open systems are interoperability and appli- 
cation portability. To this extent, open systems negotiate a set of common functionality so that they can share a common 
view of each other, thus hiding any internal characteristic peculiar of each system. 

[0064] As background information, following please find briefly summarized some OS! concepts concerning with the 
Application, Presentation, and Session Layers, with the focus being only on those aspects, which the author considers 
as essential for formalizing this invention. 



50 



V.I The Application Layer in the OSI Model - Background Information 



55 



[0065] Figure 4 presents a high level view of the OSI Application Layer, This layer is the topmost one in the 7-layer 
OSI architecture. As such, this layer offers a service directly to the final user, i.e. the Application Process (AP). The 
Application Process 20 is actually outside the scope of the OSI: within the OSI model, an Applk^atlon Process is rep- 
resented by an Application Entity 2^ (AE). An AE 21 is defined as a set of: 



• A User Element22 (UE), which represents the AP 20 to the AE 21 , therefore being the joining element between 
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the real system and its representation as open system. 

• Acollection oUog\ca\\ycorre\ate6 Application Service Eiements 23, 24 (ASE)each defined as afunctional module. 

5 [0066] The OSI Application Layer thus provides said AEs with functionality for supporting communication at Appli- 
cation Process level This functionality is carried out through protocols designed for specific applications and/or general- 
purpose routines. 

[0067] The AE nature is determined by the choice of the ASEs being used. These elements can not exist by them- 
selves. Therefore, an application entity is composed of one or more ASEs, each accomplishing a specific task on behalf 

10 of the user application. As a consequence, the architecture of the application service differs considerably from the 
architecture of the other OSi layers; in fact, the latter can be represented by an entity that offers a particular service, 
while the application layer can be represented through the set of ASEs and negotiable options. 
[0068] More specifically, each Application is characterized by a set of Specific ASEs (SASE), ad hoc defined and 
offering functionality that are typical of the application they have been designed for (e.g. FTAM manages file transfer 

15 functionality). 

[0069] Furthermore, any functionality that is common to multiple types of applications can been abstracted out. The 
corresponding ASEs are called Common ASE (CASE). In particular, any ASE offering services to another ASE can be 
considered as a CASE. 

[0070] From a procedural perspective the cooperation among application processes lakes place thorough logical 
20 bounds, called Application Association, established between each couple of AE residing in different processing units. 
The AE originating an association is called Association Initiator, whereas the other peer is called Association Respond- 
er. Therefore, an Application Association is the relationship between two AEs, and offers the required reference struc- 
ture for allowing them to cooperate. 

[0071] The procedures for establishing associations include the exchange of proper Application Protocol Data Units 
25 (APDU), by using the services offered by the OSI Presentation Layer. Said APDUs also conveys control infonnation, 
which the AEs can use for managing the Application Association and coordinating their functionality. 
[0072] For each Application Association, the way information is exchanged needs to be defined: to this extent, the 
set of procedures used between the AEs is called the Application Context of the given Application Association. An 
Application Context is whatever type of information AEs require for cooperating over a given Application Association. 
30 In particular, said context would always include the description of the set of ASEs used by each AE involved in said 
association. 

[0073] To this extent, in order to ease the definition of processes that concur in setting up the communication between 
AEs, some abstract models have been identified, each logically grouping functionality that have already been defined 
for a given Application Context. The Single Association Object (SAO) is the abstract model of the functions correspond- 
35 ing to a specific application association. It is composed of one or more ASEs, among those belonging to the given AE. 
[0074] Since the ASEs belonging to a SAO are those that are part of the Application Association represented by the 
SAO, one of them must be the Application Control Service Element (ACSE). This ASE deals with the establishment, 
release, and abort of Applications Associations. 

[0075] Within each SAO one can identify the procedures that regulate the interactions among ASEs, and those which 
40 regulate the interactions among said ASEs and the OSI Presentation Layer. The Single Association Control Function 
(SACF) is the abstract model that identifies the set of said procedures; it represents the execution of rules defined 
within the application context, and therefore Its description is implicitly contained within the Application Context and, 
in particular, in the ASEs descriptions. 

[0076] If the Application Entity opens more associations, multiple SAOs can be correspondingly identified. These 
45 SAOs can feature different combinations of ASEs. A Multiple Association Control Function (MACF) can be used if 
some fomn of coordination is required among some or all the Application Association of a given AE. Substantially, the 
MACF governs le interactions among a group of SAOs within a given AE, over some associations. That is, the temporal 
sequence of events within the various associations, the relationships among them, and everything that could be useful 
for the management of a multiple association. 
so [0077] Figure 5 depicts the use of AEs (i.e. Application Entity Invocations); it shows two Application Associations, 
one between two instances of SAO 1 and the other between two instances of SAO 2. In both cases, the MACF controls 
the use of services offered by SAO 1 and SAO 2 in AEI 2. Even though not indicated in the figure, direct associations 
without the mediation of any MACF are of course also possible. 
[0078] Examples of ASEs are: 

55 

• ACSE (Association Control Service Element): deals with the establishment, release, and abort of Applications 
Associations. 
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• FTAM (File Transfer Access and Management): deals with file transfer functionality in the OSI context. Historically, 
this has been one of the first ASEs ever developed, and it is one of the most interesting applications. 

• RTSE (Reliable Transfer Service Element): offers the procedural elements for the reliable transfer of information. 
5 This functionality mirrors the OSI Session Layer one, but offers the possibility of using ASN.I rather than byte 

formats thus simplifying the complexity of the Session Layer. 

• ROSE (Remote Operation Service Element): allows the support of event those distributed applications, which are 

not strictly based on the client-server model. 

10 

• CCR (Commitment Concurrency Recovery control): designed for managing distributed applications, by solving 
consistency and concurrency problems that might occur in such cases. 

• CM IS E (Common Management Inf omiation Service Element) and SMASE (System Management Application Serv- 
es Ice Element): they both deal with network management in the OSI context. Both rely on ROSE. 

V.2 The Presentation Layer in the OSI Model - Background Information 

[0079] The OSI Presentation Layer establishes, manages, and terminates communication sessions between OSI 
^0 Application Layer entities. The OSI Presentation Layer main purpose is to render virtual any syntactical difference 
(Whereas the OSI Application Layer main purpose is to render virtual any semantic difference among applications in 
an open system. This means to ensure that said applications share a common dialogue context, that is whatto discuss 
about and how to do that. A common semantic implies the use of a common syntax.), which might exist among the 
various applications cooperating in an open system context. Another key feature of this Layer is data encryption, which 
^5 is, however, outside the scope of this writing. Encryption can be accomplished theoretically in any of the seven OSI 
layers, but actually only the Physical, the Session and the Presentation Layers are considered by some authors as the 
most suitable ones. This goal can be achieved by either using common transfer syntax, or a common external repre- 
sentation of data. 

[0080] The concrete data structures in the local syntax are mapped to data types, which describe them in terms of 
30 an Abstract Syntax. An example of Abstract Syntax is the ASN. 1 standard. A Transfer Syntax is then applied to the 
Abstract Syntax, in order to obtain the value corresponding to a given abstract data type (serialization). 
[0081] The couple (Abstract Syntax, Transfer Synta)^ is called Presentation Context, which is defined by the Pres- 
entation Layer for implementing its functionality. Actually, this Layer supports two types of contexts: 

35 • A Defined Context, which is the one agreed upon among the two users and the Presentation Layers, through a 

negotiation process. 

• A Default Context, which is always available at the Presentation Layer. This context is used if the Defined Context 
has not been agreed upon. 

40 

[0082] In order to expedite the negotiation process, each Presentation Context is assigned a Presentation Context 

identifier (PCI), an integer value that can be used for later referencing a specific context. 

[0083] For instance, an AE can be composed of two ASEs. Each ASE may define its own abstract syntax for com- 
municating with the peer ASE. Generally, these abstract syntaxes can differ. In order to avoid confusion, two distinct 
45 Presentation Contexts, one per ASE pair, are set up during the presentation connection establishment. This distinction 
is achieved by marking each context with a specific PCI. 

[0084] The Presentation Layer mandates a set of services and protocols dealing, among other functionality, with the 
Presentation Context negotiation (at presentation connection establishment time) and renegotiation (during the con- 
nection lifetime) process. 

so [0085] At connection establishment time, a Defined Context Set (DCS) is negotiated. The initiator first specifies in 
said DCS a list of all the Presentation Contexts that it can handle. For each context, the PCI and the Abstract Syntax 
are specified. The Initiator does not specify anything concerning with the Transfer Syntax. The OSI Presentation Layer, 
used by the Initiator, in fact provides this information. The presentation entity adds a//the possible Transfer Syntaxes 
that are compatible with a given Abstract Syntax listed in the DCS. If no Transfer Syntaxes are available for a given 

55 Abstract Syntax, an exception is raised to the application process, and the corresponding item is removed from the DCS. 
[0086] The complete DCS infomnation is then sent to the peer OSI Presentation Layer, whbh checks whether the 
specified Transfer Syntaxes can be supported, and then forwards to the local user (the Respondei) the following in- 
fomnation for each Presentation Context listed in the DCS: 
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• PCI 

• Abstract Syntax 

• A flag indicating whether a particular Presentation Context has been accepted or not (acceptance or provider 
rejection). 

5 

[0087] Should a given context be rejected, one of the following reasons are specified: 

• Unspecified Reason 

• Unsupported Abstract Syntax 

10 • None of the proposed Transfer Syntax has been accepted 

• Reached DCS Local Limit 

[0088] The Responder then replies to its presentation service provider, which Presentation Context the Responder 
is able to support. The Presentation Layer communicated this information back to the originator peer, in terms of: 

15 

• PCI 

• Abstract Syntax 

• Flag: acceptance/provider rejection indicator 

• The chosen (unique) Transfer Syntax 

20 

[0089] This infomnation is forwarded to the Initiator and the negotiation is over. The DCS contains now only those 
Presentation Contexts (each with its own unique Transfer Syntax) that both peers can support. 
[0090] This process can be repeated at any time, during the lifetime of a presentation connection. 

V.3 The Session Layer in the OSI Model - Background Information 

[0091] The OSI Session Layer establishes, manages, and tenninates communication sessions between OSI Pres- 
entation Layer entities. More specifically, the Session Layer main purpose is to structure and regulate the data flow 
among users, managing any failure and/or exceptional event that might occur. In order to deal with the latter aspects, 
30 the session service relies on the c/iec/cpo/nf concept A checkpoint is a logical mark inserted during the lifetime of a 
connection between two users. When a failure/exception occurs, provisions are made available for recovering from 
the given event by rolling back to one of the connection states marked with a checkpoint. 

[0092] The OSI Session Layer can map session connections to transport connections (offered by the underlying OSI 
Transport Layer) in different ways: one-to-one correspondence, one session connection over multiple transport con- 
35 nections, multiple session connections over one transport connection. Transport connections can be reusec/for multiple 
session connections, or new ones can be established for given session connections. This transport connection assign- 
ment is based on the users' QoS requirements. 

V.4 A formal description of the proposed OoS Adaptation Framework 

40 

[0093] Figure 6 presents the QoS Adaptation Framework described in § Adaptation Framework, confomning to the 
OSI concepts indicated in § The Application Layer'm the OSI Model - Background Information, The Presentation Layer 
in the OSI Model - Background Information, and The Session Layer \n the OSI Model - Background Information. The 
tollowing formal description refers to the full-fledged middleware supporting application type B.3. The same concepts 

^5 can be applied, mutanda mutandis, to the application types B.1 and B.2. 

[0094] The QoS Broker 30 (i) implements the main QoS adaptation logic and (ii) coordinates the various entities (e. 
g. the management of applications; the coordination of associations, sessions, and streams). The QoS Broker is a 
component itself and as such, a central Component Coordinator SW Unit manages it. This Unit manages also all the 
other components that fit into the architecture. More specifically, the QoS Broker 30 relies on an extemal component, 

50 the NRB 31 , which however users can othenwise directly access through a specific GUI (this applies to any type of 
applications - with only some limitations for applications type A.1 and A.2, where no QoS signaling is available, but 
QoS configuration is allowed). 

[0095] The Application Process 32 (AP) represents the user application. The AP 32 can use the middleware, but the 
middleware only Indirectly affects it. The middleware in fact performs QoS adaptation by tuning the AP resource usage, 
55 as described in § Application Model. To this extent, the AP 32 is associated with an AE instance 33 (AEI). The asso- 
ciation is actually realized through an UE 34, which represents the AP 32 within the middleware. The UE 34 contains 
infonnation concerning the AP 32, like priority, class (see § Application Model), and (if any) configuration infomiation 
(for instance some memory requirements) that might be useful for perfonning admission test and the fallback mecha- 
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nisms. The UE 34 also coordinates a list of open sessions (for the sake of simplicity, the figure represents only one 
session), under QoS Broker 30 direct control. 

[0096] Each session, as described In § Connmunication Model, can be split in several associations. The set of said 
associations is coordinated by the Session Manager 35, which therefore acts as a MACF. under QoS Broker direct 
5 control. 

[0097] Each association is represented by a SAO 36, 37: the Chain Coordinator 38 (see § Adaptation Framework) 
acts as a SACF, by coordinating ASEs (like multimedia conriponents and Resource Managers - see § End System 
Reference Architecture), under QoS Broker direct control. More specificalty> the Chain Coordinator 38 handles multiple 
chains each eventually associated with a given stream. To this extent, ASEs are instantiated per stream. Furthermore, 

10 certain components can be implemented as stubs, which represent a high level interface of the given components. 
This level of indirection introduces polymorphism property in the architecture: the actual component implementations 
(skeletons) are typically handled within the OSl Presentation Layer as a sort of component skeleton library. In most of 
the cases, in fact, multimedia components deal with typical OSl Presentation issues, like e.g. encoding, compression, 
and encryption functionality. On the other hand, multimedia components that cannot be modeled in this way are e.g. 

IS those which deal with multimedia device drivers. Which skeleton will be actually used, depends on the result of an 
extended Presentation Context negotiation process, as described below. 

[0098] To this extent, the present invention slightly differs from the OSl model: the QoS information is negotiated 
beforehand at the highest layers, and only later communicated to the OSl Transport and lower layers, in terms of 
negoUaled QoS requirements specific to the physical connections that have to established. 
20 [0099] Being implicitly included in the OS context, the Resource Controllers are therefore not indicated in Figure 6 

for simplicity reasons. 

V.4.1 Extended Presentation Context Negotiation Process 

25 [0100] The idea is to leverage the existing Presentation Context Negotiation Process for exchanging additional con- 
text infomnation among peers. More specifically, in addition to the Abstract Syntax (which might in certain cases do not 
even apply - the OSl model is hereby used only as a reference model, and not all of its concepts are hereby enforced), 
the peers now will exchange QoS information, in terms of: 

30 • List of component stubs to be used 

• Application QoS Profile 

• Session QoS Profile (if any session is to be used, assumes one session will be used by default) 

• Association QoS Profile (assumes one association will be used by default) 

• Stream QoS Profile (if any stream is to be used, assumes one stream will be used by default) 

35 

[0101] The Association and Stream QoS Profiles contain estimated information concerning protocol stack resource 
usage. These estimates are computed through the Resource Managers dedicated to each flow and resource type, in 
conjunction with the centralized services offered by the resource controllers. QoS Brokers shall then tune these esti- 
mates during the runtime, using the adaptation mechanisms described in § Adaptation Mechanisms. 

40 [0102] The ASE information is organized in a DCS: a PCI, an Abstract Syntax (if any required), and a Component 
Stub (if any needed) are assigned to each ASE that needs to establish a communication with a peer one. For Instance, 
the initiator may choose to use a data compressor with a given compression ratio: given that the two peers may have 
various brands/flavors of compressors. These compressors might even be not fully compatible with respect to each 
other. Therefore, the peers need to agree (I.e. negotiate) upon which actual compressors (i.e. Skeletons) they shall 

•^5 use. Being simply piggybacked by QoS Presentation Layer protocol data units, the QoS Profiles are placed in front of 
the DCS. In order to con^elate session, associations, and streams, each Profile is associated with an Identifier, as 
indicated in Figure 7. 

[01 03] For the sake of simplicity, this figure represents the specific case of one session , one association, one stream, 
and one ASE description. More generally, each of these descriptions can be replicated according to the actual entities 
50 been active, so as to group negotiation information in one data structure. This typically applies to ASEs, but can be 
extended as well to the other abstractions. 

[0104] The Presentation Layer serving the Initiator shall complete the negotiation infomnation to be sent to the peer, 
by selecting from the libraries the Transfer Syntaxes (see § The Presentation Layer in the OSl Model - Background 
Infomnation) and the Component Skeletons that comply respectively to the specified Abstract Syntax and Component 
55 Stubs. 

[0105] At the peer side, the OSl Presentation Layer shall validate the Transfer Syntaxes (if any) and Component 
Skeletons (if any), and relay the resulting information to the Responder. The Responder is shepherded by the peer 
QoS Broker: admission test and fallback mechanisms (see § Application Model) are performed at the various layers 
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(including the lower layers), and a response is handed back over the Initiator accordingly. This scheme is based on 
the same mechanisms described in § The Presentation Layer \r\ the OSI Model - Background Infomiation. 
[0106] The negotiation process can be repeated in case the Initiator is not satisfied with the Responder feedback. 
In every step, the resources are allocated along the path, as indicated in Figure 9 (see § Proposal of a Standard QoS 
5 Negotiation Protocol for a detailed description of this figure). 

[0107] The same mechanisms can be applied to the renegotiation process, the main difference being that the com- 
munication links among peers are already established. 

[0108] What presented so far reflects an ideal world case, where a specified set of QoS requirements can be specified 
once forever, and the QoS Brokers are able to satisfy said requirements by simply tuning the overall systems in a 
10 coordinated manner. 

[0109] In the real world, however, sudden QoS violations can be so dramatically big to drive the QoS Brokers offset. 
In such a case, proper degradation path information (see § Adaptation Mechanisms) shall be included in the negotiation 
infonnation. This additional information can be structured as additional sets of information, in the same way as indicated 
in Figure 7 (which represents the reference context). In order to distinguish items belonging to the degradation path 

15 from the ones belonging to the reference context, each item (the description In Figure 7) shall assigned an ID, math- 
ematically correlated with the corresponding item in the reference context The mathematical relationship could be a 
proper hierarchical bit mapping scheme, or any other solution. This invention does not mandate any specific relation- 
ship, as this is seen to be an implementation dependent issue. Figure 8 presents a sample case of degradation infor- 
mation applied to the negotiation information. 

20 [01 1 0] As indicated in § Adaptation Mechanisms, the renegotiations can thus be limited to a simple item ID exchange, 
and only when the two QoS Brokers do need to synchronize. By default, in fact, the QoS Brokers are assumed to be 
able to use degradation path infonnation at the unison. Only if, after a configurable timer has expired, the monitored 
QoS is still violating the (degraded) QoS requirements, the QoS Brokers initiate a renegotiation process, where only 
the sots of chosen items IDs are negotiated (given that the corresponding information has already been negotiated at 

25 connection establishment time). 

[0111] Only in the case one of the peers has got corrupted the previously negotiated Information, or whenever the 
user has modified her/his configuration information, an explicit renegotiation process (similar to the one described for 
the reference negotiation case) shall apply. A QoS Broker receiving such an explicit request shall automatically be 
forced to discard previous information and complete the renegotiation process, as if it was a new negotiation process. 

30 

V.4.2 A final note about the OSI Presentation Layer 

[0112] So far the proposed QoS Adaptation Framework has been described with respect to an OSI Presentation 
Layer, with augmented negotiation capabilities. This concept has been introduced for fomnallzing said framework, ac- 
35 cording (to a certain extent) to the OSI model. 

[0113] From an Implementation point of view, however, the OSI Presentation Layer functionality is partly included in 
COTS Session protocol implementations (like SIP) and partially in the QoS Broker Component. More specifically, the 
QoS Broker Component can be thought of as composed of a set of four major components: 

40 • QoS Profiles Database Management System 

• QoS Parameters Mapper 

• QoS Control/Coordinated Adaptation Finite State Machines 

• QoS (re) Negotiation Engine 

^5 [0114] The latter component Is dealing with all the logic behind the negotiation process, whereas session protocols 
like SIP can be used for Implementing the negotiation protocol, 

V.4,3 User interaction 

50 [0115] The negotiation process has been described so far as a completely automatic mechanism. Indeed, the QoS 
Broker offers a high level of automation. Nevertheless, the Responder can agree with the initiator upon establishing 
any given session, association, and stream, provided that human control is exerted at some level. 
[0116] The Responder could in fact be an instance of configured automata (i.e. a Video on Demand server), or just 
a human picking up a call (e.g. a videoconference application). Even in the latter case, however, the user can program 

55 the QoS Broker to take into account details (such as QoS related issues), thus being able to take high level decision 
(accept / reject / modify the call request). 
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VI. Proposal of a Standard QoS Negotiation Protocol 

10117] This invention proposes the standardization of a generic QoS Negotiation Protocol: this protocol is not tight 
to any particular network technology. Actually, rather than proposing yet a new full blown protocol, this invention de- 
5 scribes a meta-protocoK which can be implemented by mapping the procedures and the information elements described 
below, to existing protocols like, e.g., SIP. 

[0118] To this extent, generic logica! messages (thereinafter indicated as methods), like association establishment, 
stream establishment, acknowledgements, and renegotiation, are widely used in order to represent the negotiation 
signaling between the peers, which is therefore performed in-band. 

10 [0119] These generic messages shall be mapped to the protocol specific analogous messages. Provided that the 
selected protocol specification allows extensibility features. Otherwise, proper actions shall be taken within the proper 
standardization bodies in order to explicitly support the infonnation elements hereby-described. The important aspect 
of this invention is that real-protocol messages piggyback the negotiation information (including degradation paths), 
along with the usual infonnation. This lazy approach implies that no explicit negotiation messages are required what- 

15 soever, thus reducing the complexity of the protocols and the setup (or recovery, as in the case of renegotiations) delay. 
[0120] Furthermore, simple end-to-end scenarios are hereby described: the use of intermediate network entitles (like 
proxy servers, gateways, etc.) is implementation specific and does not alter the scope of the meta-protocol. Actually, 
one of the peers could eventually be a QoS Broker embedded within the network (case of active networks). 

20 VI. 1 Sample Scenarios 

[0121] Figure 9 presents the three most important scenarios: association establishment, stream establishment, and 
renegotiation (in this case, due to a Hand-Over event). 

[0122] The session establishment scenario is illustrated in said figure, with respect to the peer B (which, in these 
25 scenarios, acts as the callee). As for what peer A (the caller) concerns, the session may have already been established 
during a previous association establishment with another peer Nevertheless, as described in § Session Establishment, 
during each association establishment, session negotiation is performed with respect to the new session participant, 
by piggybacking Session QoS Profile information. 

[0123] Furthermore, during the association establishment phase, session level degradation path Information is pig- 

30 gybacked as well. 

[0124] In any case, the acknowledgement messages indicate the results of the negotiation process from the callee 
perspective. If the caller agrees on such results, resources are finally allocated, otherwise corrective actions (which 
might include interaction with the user) can be taken, in order to reformulate a new bid, by using the same message 
exchanged in the renegotiation case. For simplicity reasons, the latter case Is not indicated In said figure. 

35 [0125] The following tables describe in detail the methods and the bits they are made of. The notation used is based 
on the decomposition of methods into Information elements, each describing a particular aspect of the negotiation 
information. Information elements are then further decomposed into tokens, each describing the lowest level of infor- 
mation. Tokens can be used by multiple information elements, as welt as the iatter can be mapped to multiple methods. 
The "nf symbol indicates a manc/afo/y element. The "o" symbol indicates an optional element. In particular, degradation 

^0 path infonnation is modeled as additional information elements appended to the reference ones, and linked to the 
corresponding reference information element as described in § Extended Presentation Context Negotiation Process 
and depicted in Figure 8. 



Table 8: 



Tokens 


Name 


Description 


Length 


Length ot the infonmation element in number of bytes, this token exclusive 


Session ID 


Globally kjentifies a session among peers 


Association ID 


Identifies an association within a given session (cf. SIP Call-ID) 


Stream ID 


Identifies a stream within a given association 


PCI 


Identifies the (ASE-related) Presentation Context 


Abstract Syntax Name 


Identifies the Abstract Syntax 


Transfer Syntax Name 


Identifies the Transfer Syntax 
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Table 8: (continued) 



Tokens 


Name 


Description 


Component Stub Name 


Identifies the Multimedia Component Stub 


Component Skeleton Name 


Identifies the Multimedia Component Implementation (Skeleton) 


Stream QoS Profile 


Stream level QoS Profile, described in QML notation 


Association QoS Profile 


Association level QoS Profile, described in QML notation 


Session QoS Profile 


Session level QoS Profile, described in QML notation 


Application QoS Profile 


Application level QoS Profile, described in QML notation 


Result 


Bitmap indicating the negotiation results: a set of acceptance/provider rejection 
indicator flags 



Table 9: 



Infomnation Elements Description 


Name 


Description 


ASE Description 


Describes the Presentation Context, augmented with information about any Multimedia 
Component that might be used by the peers. 


Stream Description 


Describes the stream-related QoS information 


Association Description 


Describes the association-related QoS infomnation 


Session Description 


Describes the session-related QoS Information 


Application Description 


Describes the application-related QoS Information 


Negotiation Result 


Describes the result of the negotiation process 



35 



40 



45 



SO 



55 
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Table 10: Information Elements Structure 
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Table 11: 



Methods Description 


Method Name 


Description 


Association Establishment 


Used by the Initiatorfor negotiating with the Responderthe establishnnent of the given 
association (and, implicitly, the underlying session), with given QoS. 


Stream Establishment 


Used by either peerfor establishing a new infomnation flow within the given association 


Renegotiation 


Used by the Initiator for negotiating with the Responder a degradation path for the 
given association (and. implicitly, the underlying session), given a QoS violation. 


Ackn owledgennent 


Reports the result of a (re)negotiation back from the Responder to the initiator 



Table 12: 



Methods Structure 




ASE 

Description 


Stream 
Description 


Association 
Description 


Session 
Description 


Application 
Description 


Result 


Association 
Establishment 


m 


o 


m 


m 


m 




Stream 

Establishment 


m 


m 


m 


m 


m 




Renegotiation 


m 


o 


m 


m 


m 




Acknowledgement 


m 


m 


m 


m 


m 


m 



[01 26] The main advantageous differences between the invention and the state of the art 



PJD 


Key Aspect 


Description 


1 


Interoperability 


' Backward compatibility mechanism (see Table 6) 

• Can operate with compatible QoS proxy disseminated in tree topologies within the 
network 


2 


Modularity 


• QoS Broker, NRB, Session Manager, Component Chain Coordinator, and Resource 
Managers are all componenfs themselves. 


3 


Configurability 


' NRB can be used for configuring the protocol stack and use any kind of QoS signaling 
mechanisms 

• Multimedia Components Skeletons offer multiple implementations of a given contract 
(Multimedia Component Stub), which can be negotiated as well as Transfer Syntaxes 
and other OSI Presentation Layer-related issues. 


4 


Adaptability 


• Aggregate Resource Class concept: similar to DiffServ aggregate traffic, but applied 
to computing unit reosurces. 

• Fallback mechanism 

. Piggyback of negotiation information 

• Piggyback and pre-negotiation of degradation paths 

• Distributed fallback mechanism with booking mechanism 
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(continued) 



PJD 


Key Aspect 


Description 


5 


Standardization 


■ Formalized as an OSI-likc model (differences are the enhancements offered by this 
invention): more specifically, the hereby-proposed framework focuses on QoS 
management at a functional level (application, session, association, and stream) level, 
rather at a structural level (QoS management across protocol stack layers). The former 
is mapped to the latter by the QoS broker, but is an implementation detail. Therefore 
the proposed framework is general enough to take into account any type of applications 
that require QoS guarantees (e.g. this framework can deal also with standalone 
applications, or applications using inter-processor-communicatlon facilities offered by 
the Operating System for local communication). 

• Standard generic solution (meta-protocol) 

• Implementation independent 



Example 



[01 27] The proposed negotiation protocol can be implemented in the IP world, cast over the Session Initiation Protocol 
20 specified by the Internet Engineering Task Force. The procedures, methods, information elements, and tokens de- 
scribed in the previous sections can be in such a case mapped to SIP procedures and methods, modeled according 
to the SIP text-based message syntax. 

[0128] For instance, a possible implementation could be based on the following mapping: 



25 


Method 


SIP Method 


Notes 




Association Establishment 


INVITE 


Negotiation done during invitation 


30 


Stream Establishment 


INFO 


At the time of this writing, the SIP INFO method is still in an IETF 
draft state. Among other uses, this method is being used in HMPP 
for smoothly managing Hand-Over events. 




Renegotiation 


INFO 


At the time of this writing, the SIP INFO method is still in an IETF 
draft state. Among other uses, this method is being used in HMPP 
for smoothly managing Hand-Over events. 


35 


Acknowledgement 


200 OK, INFO 


Returning negotiation results to the initiator, as a result of an 
invitation. In response to an INFO method, another INFO method 
shall be used. 



[0129] This invention provides the framework for future implementation-specific Inventions in the area of application 
40 QoS adaptation, especially for mobile and multimedia applications. 

[0130] Table 13 captures the most meaningful aspects of this invention, putting in evidence the original Ideas being 
hereby claimed. 



Table 13: 



45 


Detailed list of the original features of this invention 




PJD 


Key Aspect 


Original Features to be claimed 


50 


1 


Interoperability 


• The fallback mechanisms described in Table 6 for providing backward compatibility 
between the various types of applications described in Table 4. 


2 


Modularity 


' The modular approach for addressing the various types of applications (described in 
Table 4): the staircase Figure 2. 

• The component-based model applied to both the High-Level QoS API and the 
Component Model API. See § Modularity. 


55 


3 


Configurability 


• The proposed framework is general enough to be accommodated on any given 
network model and QoS signaling protocol. 
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Table 13: (continued) 



Detailed list of the original features of this invention 



P ID 



Key Aspect 



Original Features to be claimed 



10 



15 



20 



25 



30 



35 



40 



• More specifically, the integration of the following SW units, which mask 
implementation details to the QoS middleware and the applications, as described in § 
Configurability: 

- Network Resource Booker (NRB): abstracts out network resource reservation 
mechanisms. It can be directly used by humans (through a proper GUI)» or use by the 
QoS Broker (see Figure 3). 

- Session Manager, coordinates multiple peer to peer associations within a session, and 
abstracts out session protocols. 

- Network Protocol Resource Controller abstracts out network protocol stack 
management (e.g. control of queue scheduler and/or data-link/physical protocol layer 
resources - through a specific data-link/physical protocol layer manager unit) 

- Memory Resource Controller abstracts out primary and secondary memory 
management 

- CPU Resource Controller abstracts out CPU management (e.g. control over the task 
scheduler) 

- Multimedia Device Drivers: abstracts out multimedia devtee details 
. See § Configurability. 



Adaptability 



• The appiication and communication modeis, along with their specific adaptation 
mechanisms, organized in a framework. 

- These models are rigorously described in terms of the ISO OSI architecture, and fomn 
the logical framework for molding the QoS (re)negotiation process in the most general 
manner. 

• The Higit-Level QoS API and the Component Model API 

• See § Adaptation Mechanisms. 



Standardization 



Methods for achieving platform- an6 network-neutral negotiation and re- 
negotiation protocols, by extensively using piggyback mechanisms and pre- 
negotiated degradation patlis. 

• These results being obtained by introducing the concept of (re)negotiation process 
as an extension of the ISO OSI Presentation Negotiation Protocol. See § Proposal of 
an Standard QoS Negotiation Protocol. 

• A SIP binding is offered as an example. This binding to be stenda/d/zed through the 
IETF standardization body. See § Example. 



[0131] More specifically, with respect to the Figure 3, this invention proposes an end-terminal QoS middleware ar- 
chitecture. 

[0132] Table 1 4 indicates the dependencies among the SW Units building up said middleware. For a more detailed 
description of each of these units, please refer to the corresponding entry in Table 14. 



Table 14: 





List of SW Units 


SW Unit Name 


Dependencies 


50 


QoS Broker 


Component lifecycle managed through the Component Coordinator. 






Coordinates the following units directly: 






- Network Resource Booker 






- Session Manager 






Coordinates the following units through Chain Coordinators: 


55 




- CPU Manager, 






- Memory Manager, 






- Multimedia Component, 
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TabiG 14: (continued) 





List of SW Units 




SW Unit Name 


Dependencies 


5 




- Network Protocol Manager, 

along with their corresponding monitors. 


10 
15 


Component Coordinator 


Manages lifecycles of the following units: 

- QoS Broker, 

- Chain Coordinator, 

- Session Manager, 

- Network Resource Booker, 

- CPU Manager, 

- Memory Manager, 

- Multimedia Component, 

- Network Protocol Manager, 


20 
25 


Chain Coordinator 


Comoonent lifecvcle manaaed throuah the ComDon6nl Ooordin?itor Rnd the OoS 
Broker. 

Coordinates the following units: 

- CPU Manager, 

- Memory Manager, 

- Multimedia Component, 

- Network Protocol Manager, 




Session Manager 


Component llfecycle managed through the Component Coordinator and the QoS 
Broker. This Unit offers a unified API with respect to existing session layer protocols, 

liW-o a. n QIP rtr l-J 

Oil sJt n.o^o. 


30 


Networl( Resource Booicer 


Component llfecycle managed through the Component Coordinator and the QoS 
Broker. Additionally, this unit can be coupled with a GUI, to provide direct human 
access to its core functionality. This Unit offers a unified API with respect to existing 
resource reservation protocols/mechanisms, tike e.g. IntServ and/or DiffServ. 


35 


CPU Manager 


Component llfecycle managed through the Component Coordinator and the Chain 
Coordinator. Associated with a monitor sub-unit, which reports filtered events to said 
Chain Coordinator. One instance of this unit (and the corresponding monitor sub- 
unit) is associated with each stream. This unit uses the CPU Resource Controller 
forgetting/changing resource global status information. 


40 


Memory Manager 


Component llfecycle managed through the Component Coordinator and the Chain 
Coordinator. Associated with a monitor sub-unit, which reports filtered events to said 
Chain Coordinator. One instance of this unit (and the corresponding monitor sub- 
unit) is associated with each stream. This unit uses the Memory Controllerf or getting/ 
changing resource global status information. 


45 


Multimedia Component 


Component lifecycle managed through the Component Coordinator and the Chain 
Coordinator. Associated with a monitor sub-unit, which reports filtered events to said 
Chain Coordinator. One or more instances of this unit (and the corresponding monitor 
sub-unit) Is associated with each stream. This unit uses the Multimedia Controller 
tor getting/changing resource global status information. 


50 


Network Protocol 
Manager 


Component lifecycle managed through the Component Coordinator and the Chain 
Coordinator. Associated with a monitor sub-unit, which reports filtered events to said 
Chain Coordinator One Instance of this unit (and the corresponding monitor sub- 
unit) is associated with each stream. This unit uses the Network Protocol Controller 
for getting/changing resource global status information. 


55 


CPU Resource Controller 


Unit providing fine-grained access/control to CPU resource global status. This unit 
can be embedded into the OS. Used by CPU Managers. 



27 

BNSDOCID: <EP 11S8740A1J_> 



EP1 158 740 A1 



Table 14: (continued) 



List of SW Units 


SW Unit Name 


Dependencies 


Memory Controller 


Unit providing fine-grained access/control to Memory resource global status. This 
unit can be ennbedded into the OS. Used by Memory Managers. 


Multimedia Controller 


Unit providing fine-grained access/control to Multimedia resources global status. 
This unit can be embedded into the OS. Used by Multimedia Components. 


Network Protocol 
Controller 


Unit providing fine-grained access/control to Network Protocol resource global 
status. This unit can be embedded Into the OS. Used by Network Protocol Managers. 
This unit can be interfaced to a data link / physical protocol layers managing unit, in 
order to allow fine parameter tuning and control over said protocol layers from within 
the QoS management plane. To this extent, the QoS and Mobility Enabled Transport 
interface Indicated In Figures would then redirect QoS-related Information/operation 
to the QoS Management plane and, through the Network Protocol Controller, to the 
data link / physical protocol layers manager unit. This unit is not explicitly indicated 
in Figures. It is envisioned that the interface between the Network Protocol Controller 
and the data link / physical protocol layers manager unit will be standardized in the 
next future. 



10 



15 



20 



Claims 



25 



30 



Processing system for one or more communication networks, providing applications with a platform- and network- 
independent framework for achieving cross-adaptability by providing components for QoS management in the 
communication nelwork(s) by means of a component coordinator unit (1 0). 

Processing system according to claim 1 , 
characterised in, 

that said generic framework uses a platform- and network-neutral set of application adaptation mechanisms, in- 
cluding a QoS negotiation and re-negotiation protocol. 



35 



40 



Processing system according to claim 2, 
characterised in, 

that said protocol uses piggyback mechanisms for QoS negotiating and re-negotiating. 

Processing system according to claim 1 , 2 or 3, 
characterised in, 

that said generic framework bases on a modular progressive approach to address different types of applications 
which span from existing application to envisioned more sophisticated applications that rely on middleware for 
achieving cross-adaptability. 



45 



5. Processing system according to one of the claims 1 to 4, 
characterised in, 

that said generic framework bases on an application model in which each application is allocated to one of a set 
of application classes having different QoS level with respect to resource usage. 



50 



55 



6. Processing system according to claim 5, 
characterised in, 

that fallback mechanisms are provided for a backward-compatibility between the application classes. 

7. Processing system according to claim 5 or 6, 
characterised in, 

said generic framework bases on a communication model with different functional communfcation levels for ex- 
ploiting the various resources in a coordinated manner so as to achieve the desired overall QoS level. 
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8. Processing system according to claim 7, 
characterised in, 

that said communication levels include an application (1), a session (2), an association (3) and a stream (4) level. 

5 9. Processing system according to one of the claims 1 to 8, 
characterised by 

a QoS broker unit (8) being managed by the component coordinator unit (10) and coordinating local and remote 
resource management by using said negotiation and re-negotiation protocol. 

10 10. Processing system according to claim 9, 
characterised by 

a network resource booker unit (9) being directly coordinated by the QoS broker unit (8) and managing network 
resource reservation mechanisms in a implementation independent way. 

15 11. Processing system according to claim 9 or 10, 
characterised by 

a session manager unit (11) being directly coordinated by the QoS broker unit (8) for establishing and managing 
sessions in an implementation independent way. 

20 12. Processing system according to claim 11 , 
characterised by 

one or more chain coordinator units (12) being managed by the QoS broker unit (8) through the session manager 
unit (11) and managing one or more component chains, each chain being associated with a stream. 

25 13. Processingsystemaccording toclaim 12, 
characterised by 

one or more CPU-manager units (13) coordinated by the chain coordinator units (1 2) for managing CPU-resource 
usage. 

30 14. Processing system according to claim 13, 
characterised by 

a CPU-resource controller unit (17) providing said CPU-manager units (13) with platform-independent resource 
status information retrieval and control. 

35 15. Processing system according to one of the claims 12 to 14. 
characterised by 

one or more memory manager units (14) coordinated by the chain coordinator units (12) for managing memory 

resource usage. 

^0 16. Processing system according to claim 15, 
characterised by 

a memory controlling unit (18) for providing the memory manager units (14) with platform-independent resource 
status information retrieval and control. 

45 17. Processing system according to one of the claims 12 to 16, 
characterised by 

one or more network protocol manager units (15) coordinated by the chain coordinator units (12) for managing 
network protocol resource usage. 

so 18. Processing system according to claim 17, 
characterised by 

a network protocol controller unit (19) for providing the network protocol manager units (15) with resource status 
information retrieval and control. 

55 19. Processing system according to one of the claims 12 to 18, 
characterised by 

one or more multimedia components (1 6) coordinated by the chain coordinator units (1 2) for managing multimedia 
resources. 
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20. Processing system according to claim 19. 
characterised by 

a multimedia controller (20) providing the multimedia component units (16) with platfomn-independent resource 
status information retrieval and control. 

5 

21 . Pieces of software for one or more communication network, being loadable in memory means of one or more notes 
of the one or more communication networks, providing 

applications with a platform- and network-independent framework tor achieving cross-adaptability by providing 
components for QoS management in the communication network(s) by means of a component coordinator unit 
10 (10). 

22. Pieces of software according to claim 21 , 

charaterised in, 

that said generic framework uses a platform- and network-neutral set of application adaptation mechanisms in- 
15 eluding a QoS negotiation and re-negotiation protocol. 

23. Pieces of software according to claim 22, 
characterised in, 

that said protocol uses piggyback mechanisms for QoS negotiating and re-negotiating. 

20 

24. Pieces of software according to claim 21 , 22 or 23, 
characterised in, 

that said generic framework bases on a modular progressive approach to address different types of applications 
which span from existing applications to envisioned more sophisticated applications that rely on middleware for 
25 achieving cross-adaptability. 

25. Pieces of software according to one of the claims 21 to 24, 
characterised in, 

that said generic framework bases on an application model in which each application is allocated to one of a set 
30 of application classes having different QoS level with respect to resource usage. 

26. Pieces of software according to claim 25, 
characterised in, 

that fallback mechanisms are provided for a backward-compatibility between the application classes. 

35 

27. Pieces of software according to claim 25 or 26, 
characterised in, 

said generic framework bases on a communication model with different functional communication levels for ex- 
ploiting the various resources in a coordinated manner so as to achieve the desired overall QoS level. 

40 

28. Pieces of software according to claim 27, 
characterised in, 

that said communication levels include an application (1), a session (2), an association (3) and a stream (4) level. 

-^5 29. Pieces of software according to one of the claims 22 to 28, 
characterised by 

a QoS broker unit (8) being managed by the component coordinator unit (10) and 

coordinating local and remote resource management by using said negotiation and re-negotiation protocol. 

so 30. Pieces of software according to claim 29, 
characterised by 

a network resource booker unit (9) being directly coordinated by the QoS broker unit (8) and managing network 
resource reservation mechanisms in an implementation independent way. 

55 31 . Pieces of software according to claim 29 or 30. 
characterised by 

a session manager unit (11) being directly coordinated by the QoS broker unit (8) for establishing and managing 
sessions in an implementation independent way. 
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32. Pieces of software according to claim 31 , 
characterised by 

one or more chain coordinator units (12) being managed by the QoS broker unit (8) through the session manager 
unit (11) and managing one or more component chains, each chain being associated with a stream. 

33. Pieces of software according to claim 32, 
characterised by 

one or more CPU-manager units (13) coordinated by the chain coordinator units (12) for managing CPU-resource 

usage. 

34. Pieces of software according to claim 33, 
characterised by 

a CPU-resource controller unit (17) providing said CPU-manager units (13) with platfomn-lndependent resource 
status information retrieval and control. 

35. Pieces of software according to one of the claims 32 to 34, 
characterised by 

one or more memory manager units (14) coordinated by the chain coordinator units (12) for managing memory 
resource usage. 

36. Pieces of software according to claim 35, 
characterised by 

a miemory controlling unit (18) for providing the memory manager units (14) with platfomn-independent resource 
status information retrieval and control. 

37. Pieces of software according to one of the claims 32 to 36, 
characterised by 

one or more network protocol manager units (15) coordinated by the chain coordinator units (12) for managing 
network protocol resource usage. 

38. Pieces of software according to claim 37. 
characterised by 

a network protocol controller unit (1 9) for providing the network protocol manager units (15) with resource status 
Information retrieval and control. 

39. Pieces of software according to one of the claims 32 to 38, 
characterised by 

one or more multimedia components (1 6) coordinated by the chain coordinator units (1 2) for managing multimedia 
resources. 

40. Pieces of software according to claim 39, 
characterised by 

a multimedia controller (20) providing the multimedia component units (16) with platfomn-independent resource 
status information retrieval and control. 



50 



55 
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